gnaw at (someone's) conscience

Translations
ronger la conscience de quelqu'un
Definitions
To cause someone to feel persistent guilt or remorse about something they have done or failed to do.